Scratch x Stack-chan: Play Scratch with Stack-chan

https://scrapbox.io/files/6683a1df82e293001ce8603c.svg

Scratch Conference 2024 Virtual Poster Session

Takeshi MUTOH aka /610t/610t

In this project, I use Stack-chan from Scratch.

Stack-chan is a hand-held super-kawaii communication robot.

There are three ways to use Stack-chan from Scratch.

I'll show you how to play with Stack-chan!!

Stack-chan

https://github.com/stack-chan/stack-chan/blob/dev/v1.0/docs/images/stackchan.gif?raw=true

Movie by meganetaaan

Stack-chan is a hand-held super-kawaii communication robot developed and published by meganetaaan Further details are: https://github.com/meganetaaan/stack-chan .

Stack-chan is created using M5Stack family.

Many Stack-chan speak with lip sync and move face with servomotors.

There are too many Stack-chan variant such like:

Software

AI: ChatGPT, speach recognition, and speech synthesis.

Bluetooth speaker

Web radio(radiko)

Play with micro:bit

Hardware

Snake

Crowler

More variants are at .

Three ways to use Stack-chan from Scratch

There are three way to use Stack-chan from Scratch.

The table below is comparison three ways.

table:3way

Method difficulty Scratch version M5Burner support AI support

Bluetooh speaker 1 (easy) 3 o o

M5bitLess 2 3 o o

M5Scratch 3 1.4 o x

M5Burner is provide to upload various firmware to M5Stack family.

You can upload firmware to M5Stack for Bluetooth speaker, M5bitLess and M5Scratch using M5Burner.

https://gyazo.com/6d5d3c1836eca452f4279db77105019d

https://gyazo.com/b4f71d4ac701bfb2890475320b0fea7e

https://gyazo.com/d74728bbaa7b68277d1197bd8a9029d2

Stack-chan as Bluetooth speaker

https://scrapbox.io/files/6683a1cb551b62001d4558f2.svg

Stack-chan can work as Bluetooth speaker.

So if your project use sound output, Stack-chan speak it.

When Stack-chan speak, he do lip sync associated its sound.

Stretch3 which is a modified Scratch server can handle speech to text and AI(ChatGPT).

So we can create "speech in -> AI(ChatGPT) -> speech out" system.

Furthermore any voice output can speak by Stack-chan!!

https://youtu.be/_EOZL21HuYg

Project details is at ｽﾀｯｸﾁｬﾝとScratchﾁｬﾝ (in Japanese).

Stack-chan with M5bitLess

https://scrapbox.io/files/6683a1df82e293001ce8603c.svg

Using M5bitLess, you can interact with Stack-chan.

M5Scratch is program for interacting Scratch 3 + Microbit More extension and M5Stack.

To interact each other, M5Stack uses Microbit More extension.

To send and receive variable data, Microbit More has label and data mechanism.

To show Stack-chan's face, I implement special label & data.

label: stack

data:

eye: show open eyes

closeeye: show close eyes

openmouth: show open mouth

mouth: show close mouth

The translation system from the microphone to the speaker is optional.

https://youtu.be/dCBc8B1xK4k

Project details is at ｽﾀｯｸﾁｬﾝ meets Scratch with M5bitLess and Scratch x M5Stack: M5Scratch and M5bitLess.

Stack-chan with M5Scratch

https://scrapbox.io/files/666d58a8c94f24001d06ff3a.svg

Stack-chan can realize with M5Scratch.

To interact each other, it uses Scratch Remote Sensor Protocol.

Remote Sensor Protocol has two command.

sensor-update var_name var_value: send and receive data named var_name and value var_value.

broadcast event: send and receive event named event.

I implement special events to show Stack-chan face.

soe: show open eyes

sce: show close eyes

som: show open mouth

scm: show close mouth

Conclusion

You can play with Stack-chan from Scratch three ways.

How about play with Stack-chan?

Scratch x M5Stack: M5Scratch and M5bitLess